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P REFACE 

This  Memorandum  describes  a  series  of  attempts  to 
solve  the  Firing  Squad  Synchronization  Problem  from  the 
standpoint  of  man- machine  symbiosis.  These  attempts 
demonstrate  an  increasing  reliance  on  man-machine  symbiosis 
and  a  decreasing  reliance  on  powerful  heuristics  and 
preplanning . 

This  work  was  done  under  the  sponsorship  of  the  Advanced 
Research  Projects  Agency. 


SUMMARY 


1' 

5HTis  Memorandum  describes  a  series  of  attempts  to 
solve  the  conceptually  difficult  Firing  Squad  Synchronization 
Problem.  These  attempts  demonstrate  an  increasing  reliance 
on  man-machine  symbiosis  and  a  decreasing  reliance  on  powerful 
heuristics  and  preplanning. 

'  Each  of  the  four  attempts  described  has  in  common  a 
clerical  checking  program  and  a  basic  backtracking  program 
for  searching  the  solution  space.  The  first  two  attempts 
at  solution — Serial  Definition  of  Productions  and  Symbolic 
Definition  of  Productions--are  non- interactive ,  entirely 
computer-directed.  The  second  two — Functional  Planning  and 
Constraint  Satisfaction — are  man-machine  symbiotic,  designed 
to  allow  the  human  to  control  and  direct  the  computer  search 
of  the  solution  space.  ^  The  Memorandum  concludes  with  the 
author's  views  on  the  benefits  and  problems  of  such  symbiotic 
systems . 
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I .  INTRODUCTION 


This  Memorandum  details  my  personal  experiences  with 
the  Firing  Squad  Synchronization  Problem  over  the  last  four 
years.  During  this  period,  I  have  tried  many  different 
approaches  toward  solving  the  problem.  The  first  sequence 
led  to  the  original  best  (smallest  number  of  states)  Minimal 
Time  Solution  yet  found.  The  remaining  attempts  have  not 
been  successful  at  either  improving  the  solution  (reducing 
the  number  of  states)  or  proving  that  it  is  the  best  possible 
solution  (although  they  have  generated  several  other  Minimal 
Time  solutions  with  this  same  number  of  states) ;  and  from 
other  than  an  intellectual  or  illustrative  standpoint,  were 
rather  unproductive. 

This  Memorandum  discusses  the  unsuccessful  attempts 
as  they  relate  to  man-machine  symbiosis.  Reviewed  chrono¬ 
logically,  they  demonstrate  a  continuing  effort  to  sub¬ 
stitute  problem-oriented  heuristics  and  interaction  of  brute 
force  and  preplanning. 
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II.  PROBLEM  STATEMENT 


In  1962,  Dr.  E.  F.  Moore  first  publically  presented 
the  problem  with  which  this  Memorandum  deals  : 

The  problem  known  as  the  Firing  Squad  Synchroniza¬ 
tion  Problem  was  devised  about  the  year  1957  by  John 
Myhill,  but  so  far  as  I  know  the  statement  of  the 
problem  has  not  yet  appeared  in  print.  It  has  been 
widely  circulated  by  word  of  mouth,  and  has  attracted 
sufficient  interest  that  it  ought  to  be  available  in 
print.  The  problem  fir.'t  arose  in  connection  with 
causing  all  parts  of  a  self-producing  machine  to  be 
turned  on  simultaneously.  The  problem  was  first 
solved  ^y  John  McCarthy  and  Marvin  Minsky,  and  now 
that  it  is  known  to  r.ave  a  solution,  even  persons  with 
no  background  in  logical  design  or  computer  program¬ 
ming  can  usually  find  a  solution  in  a  time  of  two  to 
four  hours.  The  problem  has  an  unusual  elegance  in 
that  it  is  directly  analogous  to  problems  of  logical 
design,  systems  design,  or  programming,  but  it  does 
not  depend  on  the  properties  of  any  particular  set 
of  logical  elements  or  the  instructions  of  any  par¬ 
ticular  computer.  I  would  urge  those  who  know  a 
solution  to  this  problem  to  avoid  divulging  it  to  those 
who  are  figuring  it  out  for  themselves,  since  this  will 
spoil  the  fun  of  this  intriguing  problem. 

Consider  a  finite  (but  arbitrarily  long)  one  di- 
mentional  array  of  finite-state  machines,  all  of  which 
are  alike  except  the  ones  at  each  end.  The  machines 
are  called  soldiers,  and  one  of  the  end  machines  is 
called  a  general.  The  machines  are  synchronous,  and 
the  state  of  each  machine  at  a  time  t  +  1  depends  on 
the  states  of  itself  and  of  its  two  neighbors  at  time  t. 
The  problem  is  to  specify  the  states  and  transitions 
of  the  soldiers  in  such  a  way  that  the  general  can 
cause  them  to  go  into  one  particular  terminal  state 
(i.e.  ,  they  fire  their  guns)  all  at  exactly  the  same 
time.  At  the  beginning  (i.e.,  t  =  0)  all  the  soldiers 
are  assumed  to  be  in  a  single  state,  the  quiescent 
state.  When  the  general  undergoes  the  transition  into 
the  state  labeled  "fire  when  ready,"  he  does  not  take 
any  initiative  afterwards,  and  the  rest  is  up  to  the 
soldiers.  The  signal  can  propagate  down  the  line  no 
faster  than  one  soldier  per  unit  of  time,  and  their 
problem  is  how  to  get  all  coordinated  and  in  rhythm. 

The  tricky  part  of  the  problem  is  that  the  same  kind 
of  soldier  with  a  fixed  number,  k,  of  states,  is  re¬ 
quired  to  be  able  to  do  this,  regardless  of  the  length, 
n,  of  the  firing  squad.  In  particular,  the  soldier 
with  k  states  should  work  correctly,  even  when  n  is 
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much  larger  than  k.  Roughly  speaking,  none  of  the 
soldiers  is  permitted  to  count  as  high  as  n. 

Two  of  the  soldiers,  the  general  and  the  soldier 
farthest  from  the  general,  are  allowed  to  be  slightly 
different  from  the  other  soldiers  in  being  able  to  act 
without  having  soldiers  on  both  sides  of  them,  but 
their  structure  must  also  be  independent  of  n. 

A  convenient  way  of  indicating  a  solution  of  this 
problem  is  to  use  a  piece  of  graph  paper,  with  the 
horizontal  coordinate  representing  the  spatial  position, 
and  the  vertical  coordinate  representing  time.  Within 
the  (i,j)  square  of  the  graph  paper  a  symbol  may  be 
v/ritten,  indicating  the  state  of  the  ith  soldier  at 
time  j.  Visual  examination  of  the  pattern  of  propaga¬ 
tion  of  these  symbols  can  indicate  what  kinds  of 
signaling  must  take  place  between  the  soldiers. 

Any  solution  to  the  Firing  Squad  Synchronization 
Problem  can  easily  be  shown  to  require  that  the  time 
from  the  general's  order  until  the  guns  go  off  must 
be  at  least  2n  -  2 ,  where  n  is  the  number  of  soldiers. 
Most  persons  solve  this  problem  in  a  way  which  requires 
between  3n  and  8n  units  of  time,  although  occasionally 
other  solutions  are  found.  Some  such  other  solutions 
require  5/2n  and  of  the  order  of  n-squared  units  of 
time.  For  instance,  until  recently,  it  was  not  known 
what  the  smallest  possible  time  for  a  solution  was. 
However,  this  was  solved  at  M.I.T.  by  Professor  E.  Goto 
of  the  University  of  Tokyo.  The  solution  obtained  by 
Goto  used  a  very  ingenious  construction,  with  each 
soldier  having  many  thousands  of  states,  and  the  solu¬ 
tion  required  exactly  2n  -  2  units  of  time.  In  view 
of  the  difficulty  of  obtaining  this  solution,  a  much 
more  interesting  problem  for  beginners  is  to  try  to 
obtain  some  solution  between  3n  and  8n  units  of  time, 
which  as  remarked  above,  is  relatively  easy  to  do. 


^Eiichi  Goto,  'A  Minimal  Time  Solution  of  the  Firing 
Squad  Problem,'  Dittoed  course  notes  for  Applied  Mathe¬ 
matics  298,  Harvard  University  (May  1962),  pp.  52-59, 

Vvfi th  an  illustration  in  color.  Also  a  different  version 
of  Goto's  solution  is  to  be  published,  without  the 
colored  illustration.* 

Goto's  solution  apparently  has  not  been  published.  How- 
0ver ,  independently  of  the  present  effort,  Abraham  Waksman  [2] 
has  found  a  16-state  minimal  time  solution  using  essentially 


Ref.  1,  pp.  213-214. 
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Ih#  AMM  ld««s  presented  in  the  following  section.  Fischer 
Ol  hss  Also  used  these  ideas  to  discuss  other  properties 
of  Ooe-diMnsionel  iterative  arrays  of  finite-state  machines. 


III.  GENERAL  OUTLINE  OF  A  MINIMAL  TIME  SOLUTION 


The  Firing  Squad  Synchronization  Problem  can  be  solved 
by  successively  subdividing  the  line  into  halves,  quarters, 
eighths,  etc.,  until  all  members  of  the  line  are  division 
points.  At  this  time,  they  can  all  fire  simultaneously. 

By  always  dividing  the  line  into  two  equal  parts,  and  then 
subdividing  each  of  those  parts  into  two  equal  parts,  and 
then  subdividing  each  of  those  parts  into  two  equal  parts, 
and  so  on,  the  synchronization  of  the  firing  can  be  assured. 

To  divide  the  line  into  two  equal  parts,  the  general 
simultaneously  sends  out  two  signals,  SI  and  S2  (see  Fig.  1). 
To  be  definite,  we  will  assume  the  general  is  the  rightmost 
man  in  the  line.  SI  and  S2,  then,  both  travel  to  the  left; 

SI  at  a  speed  of  one  machine  per  time  unit,  and  S2  at  a 
speed  of  one  machine  every  three  time  units.  When  SI  reaches 
the  far  end  of  the  line,  the  end  machine  sends  back  a  signal, 
S3,  that  travels  one  machine  per  time  unit  to  the  right. 
Signals  S2  and  S3  will  meet  at  the  center  of  the  line,  for 
if  P  is  the  length  of  the  line,  then  SI  and  S3  combined  have 
traveled  a  distance  of  3P/2  while  S2  has  traveled  a  distance 
of  P/2 — a  ratio  of  three  to  one,  the  same  ratio  as  their 
respective  speeds.  Since  S2  moves  to  the  left  only  once 
every  three  units,  the  machine  containing  this  signal  must 
count  to  three  (i.e.,  S2  -  1,  G2  -  2,  S2  -  3) .  By  the  state 
of  the  machine  containing  S2  when  S3  is  encountered,  it  can 
be  determined  whether  the  line  is  of  even  or  odd  length; 
and,  hence,  whether  both  machines  should  become  middle  men 
or  only  the  one  containing  S2.  These  middle  men  (or  man)  then 
act  like  the  original  general,  sending  out  both  SI  and  S2 
signals  to  the  left  and  also  to  the  right.  The  system  repeats 
this  process  over  and  over  until  all  the  men  in  the  line  are 
middle  men,  at  which  time  firing  occurs. 

Notice  that  this  process  insures  the  synchronization  of 
the  line  and  also  permits  the  determination  of  the  firing 
condition  on  a  local  basis;  i,e.,  a  machine  fires  if  it  is  a 


middle  man  and  the  machines  on  either  side  of  it  are  also 
middle  men.  Each  outside  machine  fires  if  it  is  a  middle 
man  and  the  machine  next  to  it  is  also  a  middle  man. 

This  process  will  lead  to  a  three-N  solution  (where  N 
is  the  length  of  the  line).  The  first  middle  point  is  found 
in  3N/2;  the  quarter  points  are  found  in  3(N/2)/2  additional 

units  of  time;  and  so  on. 

One  can  modify  the  above  method  to  yield  a  2N  solution 
(see  Fig.  2)  .  Assuming  again  that  the  general  is  the  right 
most  machine,  change  the  process  as  follows:  When  SI  reaches 
the  left  end  of  the  line,  the  leftmost  machine  acts  as  if  it 
were  also  a  general;  i.e.,  it  sends  out  two  signals  to  the 
right.  One  signal,  S3,  has  been  discussed  above;  the  second 
signal,  S4,  is  like  S2  except  that  it  travels  to  the  right 
instead  of  to  the  left.  The  middle  of  the  line  is  still 
found  when  S3  and  S2  meet.  When  the  middle  man  (or  men) 
created  sends  out  signals  Si  and  S2  to  the  left  (as  described 
above) ,  SI  will  meet  S4  at  the  quarter  point  of  the  original 
line.  One  can  determine  (as  above)  whether  the  length  of 
the  left  half  of  the  original  line  is  odd  or  even  from  the 
state  of  the  machine  containing  the  slower-moving  signal; 
and,  hence,  whether  there  should  be  one  or  two  middle  men. 
Notice  that  the  same  mechanism  is  used  to  find  this  quarter 
point  as  in  the  3N  solution.  However,  the  process  began 
earlier— when  the  signal  reached  the  end  of  the  line--and 
originated  at  the  opposite  end  of  the  left  half  of  the  line. 
This  process  can  be  continued  to  find  the  right  quarte*. 
point  of  the  left  half  of  the  line.  The  length  of  time 
necessary  to  find  the  quarter  point  after  the  middle  point 
has  been  found  is  exactly  the  distance  between  these  points, 
N/4.  The  time  necessary  to  find  the  eighth  point  after  the 
quarter  point  has  been  found  is  N/8,  and  so  on.  If  this  rate 
of  finding  successive  middle  points  could  be  maintained,  the 
total  solution  time  would  be  3N/2  +  N/4  +  N/8  +  N/16  +  ...» 
which  equals  2N.  However,  since  the  general  counts  as  one 


member  of  the  line,  the  length  of  the  remaining  line  is 
N  -  1.  Hence  this  solution  will  take  2 (N  -  1).  Therefore, 
if  the  above  rate  of  finding  successive  middle  points  could  be 
maintained,  a  minimal  time  solution  would  be  attained. 

This  process  does  not  produce  a  solution,  because  in 
any  interval  it  will  find  only  one  of  the  two  quarter  points 
in  the  required  length  of  time.  Again  assuming  the  general 
is  the  rightmost  man  in  the  line,  it  will  find  the  left 
quarter  point  but  not  the  right.  Thus  the  line  will  not  be 
synchronized,  and  a  solution  will  not  result.  This  can  be 
rectified  by  having  the  general  also  send  out  a  signal,  S5 
(along  with  SI  and  S2) ,  which  travels  to  the  left  one  ma¬ 
chine  every  7  units  of  time.  This  signal  and  S3  (sent  from 
the  middle  of  the  line)  will  meet  at  the  quarter  point.  Each 
middle  man  now  sends  out  three  signals  enabling  every  interval 
to  be  divided  into  quarters  in  synchronization.  However,  the 
rightmost  eighth  point  cannot  be  found  as  fast  as  the  other 
eighth  points.  (This  is  the  Scime  problem  that  occurred  with 
the  rightmost  quarter  point.)  As  before,  one  can  find  this 
point  by  having  the  general  send  out  another  signal  that  will 
travel  at  a  rate  of  one  machine  every  15  units  of  time. 
Similarly,  one  can  find  the  rightmost  l/(2tK)th  point  in  an 
interval  by  having  the  general  send  out  a  signal  that  will 
travel  at  a  rate  of  one  machine  every  2+ (K  +  1)  -  1  units  of 
time . 

Sending  out  enough  of  these  signals  would  produce  a 
minimal  time  solution  for  any  given  length  of  the  firing 
squad.  However,  the  number  of  signals  required  depends  on 
the  length  of  the  line.  Since  the  number  of  states  re¬ 
quired  for  a  machine  is  dependent  on  the  number  of  signals 
that  machine  must  handle,  the  number  of  states  required 
depends  on  the  length  of  the  line;  hence,  the  above  does 
not  constitute  a  solution  to  the  Firing  Squad  Synchroniza¬ 
tion  Problem. 
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This  process  fails  because  it  cannot  find  the  right¬ 
most  (or  leftmost  if  the  general  starts  on  the  left) 
l/(2iK)th  points  in  an  interval,  with  a  given  number  of  states 
for  all  lengths.  If  one  could  have  a  marker  that  reached  the 
right  quarter  point  and  stopped  there,  and  a  marker  that 
reached  the  right  eighth  point  and  stopped  there,  and  so  on, 
the  problem  would  be  resolved.  As  the  right-traveling  signal 
encountered  these  markers  it  would  create  middle  men,  and  the 
process  would  begin  to  subdivide  the  next  interval  in  the 
scune  manner.  The  total  distance  each  of  these  markers 
traveled  would  be  half  the  distance  traveled  by  the  marker 
to  its  left. 

Consider  the  following:  A  signal  travels  to  the  left 
at  a  rate  of  one  machine  every  unit  of  time.  Every  second 
time  it  moves,  it  sends  out  a  signal  to  the  right  that  travels 
at  the  S2une  rate.  When  this  signal  reaches  a  marker  (a 
machine  in  a  given  state),  the  marker  moves  one  machine  to 
the  left.  Every  second  time  this  marker  moves,  it  sends  a 
similar  signal  to  the  right  that  causes  the  next  marker  to 
move.  Each  marker  behaves  in  this  manner,  moving  to  the  left 
when  it  receives  a  signal  from  its  left;  and,  every  second 
time  it  moves,  sending  a  signal  to  its  right  for  the  next 
marker.  Finally,  the  general  acts  as  a  source  of  these 
markers,  producing  one  on  its  left  every  time  it  receives  a 
signal. 

We  now  have  a  system  in  which  each  marker  travels  half 
as  far  as  the  marker  in  front  of  it;  and,  no  natter  how  long 
the  line  is,  enough  of  these  markers  are  produced  to  sub¬ 
divide  the  line  properly. 

When  the  original  signal  reaches  the  end  of  the  line, 
the  process  already  described  is  repeated  with  all  directions 
reversed.  At  this  time,  the  first  marker  has  not  yet  reached 
the  middle  of  the  line  because  all  the  signals  causing  it 
to  move  have  not  been  received.  Ko  new  signals  causing  move¬ 
ment  of  the  markers  will  be  produced,  so  they  will  ultimately 
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stop  at  the  correct  positions  in  the  line.  Since  the  move¬ 
ment-causing  signals  travel  at  the  same  rate  as  the  original 
signal,  none  of  these  signals  can  be  overtaken  by  the  original 
signal  from  the  far  end  of  the  line.  Hence,  when  this  signal 
reaches  the  marker,  all  the  signals  causing  that  marker  to 
move  will  already  have  been  received;  therefore,  the  marker 
will  be  in  the  correct  position.  In  any  interval,  two 
separate  processes  find  the  quarter  points.  The  process 
first  described  in  the  3N  solution  finds  the  quarter  point 
farthest  from  the  middle  man  who  initiated  the  subdivision 
of  the  interval.  The  process  just  described  finds  the 
quarter  point  nearest  this  middle  man.  The  length  of  time 
required  to  find  these  quarter  points  after  the  middle  of 
the  interval  has  been  found  equals  the  number  of  machines 
between  the  quarter  points  and  the  middle  point  for  both 
processes.  Hence,  the  quarter  points  will  be  found  simul¬ 
taneously,  the  solution  will  remain  synchronized,  and  this 
process  will  produce  a  minimal  time  solution  (since  there 
is  an  unlimited  source  of  markers,  the  problem  can  be  solved 
with  a  fixed  number  of  states  no  matter  how  long  the  lineji. 


IV.  SOLUTION  ATTEMPTS 


The  use  of  the  computer  as  an  aid  in  solving  the  Firing 
Squad  Problem  occurred  quite  early,  but  only  after  the  con¬ 
ceptual  framework  described  in  this  Memorandum  had  been 
established.  The  computer  was  first  used  strictly  clerically 
to  accept  a  definition  of  the  soldiers  as  a  set  of  produc¬ 
tions  and  to  simulate  their  behavior  for  a  number  of  dif¬ 
ferent  length  lines  (noting  any  errors  in  this  behavior) . 

The  interaction  consisted  of  scanning  the  output,  deciding 
on  changes,  making  them,  and  restarting  the  process  (response 
time  8-10  hours).  Using  this  mechanism  alone,  I  obtained 
a  twenty-eight  state  minimal  time  solution  and  reduced  it  to 
an  eight-state  minimal  time  solution.  At  this  point  I  began 
(with  my  trusty  computer)  searching  for  a  better  solution 
or  a  proof  that  no  better  solution  existed.  While  I  did  not 
succeed  in  this  search,  the  attempts  provide  an  interesting 
collage  of  some  ways  a  man-machine  partnership  can  attack  a 
conceptually  difficult  problem. 


— - g-ERJAL  DEFINITION  OF  PRODUCTIONS 

Brute  force  obviously  could  not  search  the  solution 

apace  exhaustively  (there  are  1*101244  possible  seven-state 

emor'°l'^'  heuristic  above  brute  force  was 

In  decisions  until  you  must. 

In  the  present  context  this  means: 

1)  start  the  simulation  with  all  productions  undefined, 
an  undefined  production  is  encountered,  define 
It  to  the  first  state  and  continue  the  simulation. 

an  error  is  found,  back  up  the  simulation  to 
the  definition  point  of  the  most  recent  production. 
Change  its  definition  to  the  next  state,  and  con- 
tinue  the  simulation. 

4)  If  there  are  no  more  states  to  try  in  #3  above, 
return  to  the  previous  production,  if  no  more 
productions  exist,  quit. 

This  process  win  exhaust  the  possible  search  space,  finding 

any  solutions  that  exist  or  proving  that  none  exist.  This 
he  familiar  technique  of  Backtrack  Programming  (4). 

States  fu°*h'^  heuristic  utilising  isomorphism  among  unused 

two  d  the  search  apace  by  approximately 

TtZTT  —red  with  Lis 

becZe’thT 

ecause  the  search  space  was  still  too  large  for  seven-state 
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VI.  SYMBOLIC  DEFINITION  OF  PRODUCTIONS 


Having  failed  to  find  that  a  better  solution  existed 
or  to  prove  that  it  did  not  via  Backtrack  Prograiruning ,  and 
noting  from  more  than  adequate  computer  output  that  this  tech¬ 
nique  spent  most  (would  you  believe  att?)  of  its  time  looking 
down  implausible  trails,  I  escalated  one  more  level.  In¬ 
stead  of  holding  off  decisions  until  needed,  I  refrained  even 
longer,  making  pseudo  (symbolic)  decisions  and  continuing. 
Ultimately,  each  pseudo  (symbolic)  decision  was  converted 
to  a  real  decision  in  a  Backtrack  Programming  algorithm  and 
the  results  of  such  a  decision  could  then  be  observed — thus 
providing  a  means  of  look-ahead.  The  results  of  a  decision 
could  be  observed  at  the  time  of  that  decision;  so,  I  thought, 
large  portions  of  the  search  space  could  be  pruned  later. 

This  method  starts  a  simulation  of  the  Firing  Squad; 
but,  as  an  undefined  production  is  encountered,  rather  than 
a  decision  of  what  state  should  be  produced,  a  new  symbolic 
state  is  created  and  the  simulation  continues  until  a  suitably 
large  structure  has  been  built  up.  Then,  using  a  Backtrack 
Programming  algorithm,  symbolic  states  are  converted  to 
actual  states.  With  each  such  assignment,  the  computer  first 
checks  for  contradictions.  The  only  kind  of  contradiction 
that  can  occur  in  this  approach  is  two  productions  that  have 
equal  left-hand  sides  but  unequal  right-hand  sides.  Such 
contradictions  produce  backtracking.  Second,  finding  no 
contradiction,  the  implications  of  the  assignment  are  handled. 
These  implications  occur  when  two  productions  exist  with 
equal  left-hand  sides  but  with  at  least  one  right-hand  side 
still  symbolic.  To  avoid  a  later  contradiction,  the  right- 
hand  sides  are  equated.  These  new  assignments  and  any  new 
assignments  they  produce  are  processed  in  the  same  manner 
until  either  a  contradiction  is  found  or  no  more  implications 
are  generated.  These  generated  implications  provide  the  look¬ 
ahead  capability. 
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The  amount  of  look-ahead  depends  only  on  the  amount 
of  structure  (simulation)  generated  before  making  actual 
assignments.  The  number  of  symbolic  productions  generated 
is  proportional  to  the  amount  of  simulation.  Unfortunately, 
the  search  required  to  look  for  contradictions  and  implica¬ 
tions  is  proportional  to  the  square  of  the  number  of  produc¬ 
tions.  When  enough  structure  is  generated  to  get  an  ade¬ 
quate  amount  of  look-ahead,  the  number  of  productions 
generated  is  large  enough  to  slow  down  the  processing  to 
the  point  where  it  more  than  offsets  any  advantage  gained 
from  look-ahead. 

Thus,  this  approach  resulted  in  nothing  new.  As  with 
the  exhaustive-search  method,  it  was  handled  entirely  by 
the  computer  without  any  interaction. 
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VII.  THE  TRANSITION  TO  COOPERATION 


)ty  f Allures  had  convinced  me  that  one  could  not  ex- 
k^^tllvely  search  the  entire  search  space  (even  as  con- 

by  A  suitable  set  of  heuristics).  Since  I  believed 
leiMi  still  do)  that  a  seven-state  Minimal  Time  Solution 
•  *|sis,  I  tried  two  approaches,  both  consisting  of  a  basic 
prograsesing  algorithm  in  the  machine  and  a  man- 
aa«hine  interface  by  which  I  could  suggest  where  and  for 
»%at  to  search.  At  tnis  point,  my  outlook  changed  entirely. 
■keUMt  thA.n  Attempting  to  build  bigger,  more  powerful 
bMSlstic  tools,  I  tried  to  design  simple  algorithms  that 
(  ooeld  effectively  direct  through  the  man-machine  inter- 
fa««.  I  wanted  to  be  able  to  specify  the  outline  of  a 
saletlosi  in  my  terms,  and  to  have  the  machine  fill  in  the 
4m tat  Is  and  produce  an  actual  solution  of  the  form  specified. 

Im  retroepect,  this  might  seem  an  obvious  course  to 
fell'Jwi  but,  at  the  time,  although  I  was  familiar  with  on- 
)|«M  •mvironments ,  I  had  to  undergo  a  serious  rethinking 
•4  Use  problem,  not  from  an  implementation  standpoint  (which 
vss  fairly  straightforward)  but  on  the  conceptual  level.  I 
bs4  to  switch  my  thin)cing  from  "How  can  I  (embodied  either 
a*  siyself  or  as  a  non- interactive  program)  find  a  solution?" 
to  can  v#  find  a  solution?"  The  approaches  discussed 

im  ti»«  following  two  sections  reflect  this  shift  in  view- 
fOiati  and,  since  they  are  presented  chronologically,  an 
ISkOfaased  emphasis  on  interaction,  feedback,  and  control 
Of  tbe  anarch  process. 
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VIII.  FUNCTIONAL  PLANNING 

From  my  attempts  to  find  solutions,  it  was  apparent 
that  I  started  with  a  plan,  or  outline,  that  stated  what 
job  or  group  of  jobs  each  state  in  the  attempted  solution 
would  perform;  i.e.,  each  state  was  given  a  function  to 
perform,  such  as  being  a  middle  man.  I  therefore  called 
this  activity  functional  planning .  After  deciding  on  such 
a  functional  plan,  I  tried  to  define  a  set  of  productions 
that  caused  each  state  to  perform  as  specified.  Note  that 
in  this  approach — as  contrasted  with  the  Constraint  Satis¬ 
faction  approach  presented  below--the  definition  of  a  func¬ 
tion  is  specified  on  a  local  (through  productions)  rather 
than  a  global  basis. 

Viewed  as  a  cooperative  venture,  I  would  propose  a 
plan  in  terms  of  the  functions  desired  for  each  state ,  and 
the  computer  would  search  the  necessary  solution  space  to 
determine  whether  or  not  a  set  of  productions  existed  that 
satisfied  the  given  plan. 

The  functions  I  used  in  my  attempts — and  that  I  en¬ 
visioned  using  in  further  attempts — could  all,  with  one 
exception,  be  defined  by  their  interaction  with  other  states 
on  a  local  basis.  These  functions  could  therefore  be  de¬ 
fined  by  a  set  of  productions  or  by  a  set  of  restrictions 
on  the  resultant  of  certain  productions.  The  basic  back¬ 
tracking  program  could  still  be  used  to  do  the  searching 
by  altering  its  behavior  so  that  through  an  input  language 
I  could  define  some  productions  that  would  remain  unalter¬ 
able  and  restrict  the  set  of  allowed  states  for  the  re¬ 
sultants  of  some  other  productions. 

The  one  function  that  could  not  be  defined  in  this 
manner  was  the  middle  man,  because  this  concept  is  not 
local — the  determination  of  the  middle  of  the  line  involves 
the  entire  line.  The  other  functions  considered  are  those 
described  in  Sec.  Ill  above.  Basically,  all  the  plans 
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proposed  were  merely  attempts  to  realize  this  general  type 
of  solution  with  the  given  number  of  states. 

This  approach  was  the  most  successful  from  two  stand¬ 
points.  First,  because  it  was  fairly  easy  to  crank  out 
several  different  eight-state  minimal  time  solutions,  in¬ 
cluding  the  one  presented  in  Ref.  5  for  which  I  obtained 
an  induction  proof.  (The  plan  was  specifically  designed 
to  make  this  proof  easier.)  Second,  and  more  importantly, 
this  approach  produced  a  conceptual  addition  to  my  thinking 
about  the  problem.  In  trying  to  specify  a  plan  through 
production  restrictions,  I  discovered  what  I  call  Image 
Solutions ,  a  formal  way  of  saying  that  the  processes  going 
on  in  one  part  of  the  line  ought  to  also  occur  in  an  image 
form — with  the  directions  reversed  and  using  different 
states— in  some  other  part  of  the  line  at  some  other  time. 
That  is,  all  interactions  within  the  line  ought  to  have  a 
counterpart  in  the  opposite  direction.  This  also  led  to 
the  idea  of  image  states  that  specify  the  correspondence 
between  states  within  image  processes.  Note  that  this  con¬ 
ceptual  breakthrough-“Which  I  now  consider  basic  to  any 
heuristic  search  for  a  solution — arose  not  through  any  actual 
man-machine  interaction,  but  through  a  man-machine  symbiotic 
relationship  in  whi.ch  the  need  to  communicate  a  complex 
feature  of  a  plan  occurred;  i.e.,  the  machine  acted  only  as 
a  catalyst,  not  taking  any  active  role  in  the  discovery. 

The  interaction  for  this  approach  involved  observing 
on-line  the  simulation  behavior  as  it  was  periodically 
printed,  and  deciding  whether  or  not  to  let  the  program 
proceed.  If  the  decision  were  made  to  stop  the  simulation, 
a  new  input  specification  of  the  plan  had  to  be  prepared 
before  restarting  the  program.  Deciding  what  modifications 
to  make  to  the  plan  specification  usually  took  between  10 
to  20  minutes,  and  actually  making  them  and  restarting  the 
program  took  about  one  minute.  The  environment  under  which 
this  was  performed  was  a  non-multiprogrammed  batch  machine 
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for  which  I  was  the  sole  user  during  my  signup  periods. 

Thus,  although  I  was  running  in  a  standard  batch  off-line 
environment,  I  was  really  on-line  with  the  program  with  an 
effective  response  time  of  one  minute. 

We  frequently  talk  about  the  response  time  of  a  com¬ 
puter  system  but  almost  never  about  the  human  response  time, 
except  for  such  trivia  as  the  time  to  hit  a  key.  In  the 
above  man-machine  system,  my  response  t<me  was  over  an  r>fder 
of  magnitude  longer  than  the  machine's;  thus  I  did  not  feel, 
during  my  work,  that  the  machine  was  not  adequately  handling 
its  portion  of  our  partnership.  Furthermore,  it  is  difficult 
to  see  how  the  machine,  for  this  approach,  could  have  further 
aided  me  to  cut  down  my  response  time.  I  was  still  performing 
too  much  work  in  the  partnership;  work  for  which  my  processing 
capabilities  were  not  well  suited. 
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IX.  CONSTRAINT  SATISFACTIOW 

Th«  l«8t  att«iBpt  at  finding  a  •olution  raiultad  from 
th«  problems  encountered  in  Functional  Planning;  mainly 
that  I  was  still  supporting  too  much  of  the  load  in  terms 
of  real  effort  expended  per  iteration.  I  tried  to  find  a 
way  of  specifying  a  plan  that  was  B»rc  natural  to  the  way 
I  was  conceptualizing  the  problem. 

My  basic  representation  was  the  two-dimensional  one 
that  Moore  HI  suggests,  and  my  plan  followed  the  kinds  of 
ideas  expressed  in  Sec.  Ill  above.  I  wanted  an  easy  way 
ot  communicating  this  to  the  machine.  Because  I  was  used 
to  looking  at  a  simulation  and,  by  observing  its  behavior 
at  various  points,  seeing  if  it  followed  lay  plan,  I  decided 
to  specify  its  behavior  in  the  same  way-- the  medium  is  the 
message.  That  is,  I  could  specify  what  state  should  occur 
at  various  points  and  along  various  lines  in  the  two- 
dimensional  representation  and  then  let  the  computer- -using 
the  trusty  backtracking  simulation  program— too  if  it  could 
satisfy  those  constraints. 

A  graphical  interactive  program  (6)  was  constructed 
that  utilized  an  IBM  2250  with  a  RAND  Tablet  as  the  inter¬ 
face  device.  With  this  program,  I  could  quickly  and  easily 
specify,  in  graphical  form,  the  constraints  I  desired  along 
any  straight  line  or  ot  any  point.  I;'»  addition,  to  restrict 
the  search  space  further,  I  could  define  frozen  (unalter¬ 
able  by  the  computer)  productions.  I  was  able  to  specify 
on-line : 

1)  What  length  line  to  work  on; 

2)  What  the  names  of  the  states  should  be; 

3)  Whether  image  solutions  were  desired  or  not,  and 
(if  so)  what  the  mapping  between  image  states  would 
be; 

4)  Whether  the  computer  should  display  the  simulation 
as  it  does  it  or  whether  it  should  run  autonomously; 
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5)  When  It  should  stop  (sftsr  ssch  ti»s  unit  in  ths 
siiBulation  or  only  on  asynchronous  intarrupts) ; 

6)  Which  productions  to  f rears  or  thaw; 

7)  Khathar  tha  first  occurranca  of  aach  production 
should  ba  briqhtanad  or  not. 

All  of  this  was  designed  to  provide  m  with  a  fast/ 
flexible/  and  facile  control  of  the  search.  This  it  did; 

I  was  able  to  vary  quickly  specify  a  sat  of  constraints 
and  soeva  frozen  productions/  turn  tha  system  IcosS/  and  gat 
a  solution  for  the  given  length  ThiS/  I  think/  is  a  note¬ 
worthy  advancwrjsnt  over  my  other  approaches. 

However/  use  of  the  system  revealed  that  this  approach 
suffers  from  two  kinds  of  problems: 

1)  Operationar  ones  such  as  a  terrible  flicker  on 
the  screen  that  makes  it  very  annoying  to  use  the 
system/  and  not  enough  core  to  include  routines 
to  save  the  current  status  so  that  at  some  later 
tine  the  system  could  be  restarted  at  that  point; 

2)  Some  lack  of  foresight  in  the  design  of  the  inter¬ 
active  simulator. 

These  design  shortcomings  include:  First/  the  con¬ 
straints  were  specified  for  only  one  length;  and  when  a 
successful  solution  was  found  for  that  length/  they  had 
to  be  re-entered/  slightly  modified/  before  trying  the  next 
length.  This  became  a  very  tiresome  chore/  one  that  should 
be  automated  in  the  next  pass  on  such  a  system.  Second/  I 
did  not  include  the  functional-planning  capability  to  talk 
about  classes  of  states  in  the  constraints.  This  proved  to 
be  a  grave  mistake/  forcing  me  to  overspecify  my  plans. 
Finally/  I  had  no  prior  inkling  that  I  would  constantly  want 
to  constrain  all  states  within  a  polygon  to  be  members  of 
a  class  of  states.  But  this  turned  out  to  bo  a  rather  basic 
part  of  the  plans;  and  without  this  capability  I  again  was 
forced  to  overspecify  the  plan  I  desired. 
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X.  COMCLUSIOri 


PrOA  th«*«  4itt«»pti  und  other  experience*  with  m«n- 
mechine  interaction,  allow  me  a  few  obaervation* .  First, 
often  one  can  proceed  much  further  with  a  rather  aimple, 

•low,  interactive  aystem  than  he  can  alone  a  little 
sya^iosis  goes  a  long  way.  Second,  the  to  comunicato 

an  idea,  an  aspect  of  a  problem,  or  a  plan  often  produce* 
a  much  better  understanding  or  oven  a  new  view  of  the  thing 
to  be  coflCTunicated--independent  of  any  later  gain  from  the 
party  to  which  the  information  was  consnunicated ,  be  it  nan 
or  machine.  Third,  the  human  rosconso  '-ii.^  «ho*'ld  br  a 
critical  design  factor,  especially  if  the  task  area  include* 
real  problewsolving  capabilities  from  the  human?  and  this 
human  response  time  should  in  large  part  determine  the 
-tightness"  or  "binding"  of  the  interactive  relationship. 
Finally,  no  matter  hov;  much  experience  one  ha*  had  with 
designing  and  building  interactive  systems,  and  no  matter 
how  well  he  knows  the  task  area,  he  cannot  foresee  all  of 
the  factors  that  will  be  relevant  in  this  system;  hence,  a 
good  interactive  system  will  require  several  passes  to 
produce.  Let  us  not  be  so  shortsighted  to  realize  that  the 
product  we  are  touting  so  highly  for  oliminating  much  pre- 
planning--man-machinc  symbiosis — is  also  required  by  us  in 
the  building  of  such  systems. 
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